BEwT-E for TAC 2009's AESOP Task

This paper describes BEwT-E (Basic Elements with Transformations for Evaluation), an automatic system for summarization evaluation. BEwT-E is a newer, more sophisticated implementation of the BE framework that uses transformations to match BEs (minimal-length syntactically well-formed units) that are semantically similar but are lexically and/or syntactically different. We present BEwTE's results on DUC and TAC datasets from 2005 to 2009 and are pleased to report that, of the systems that participated in AESOP, BEwT-E was one of the strongest performers, achieving the best performance using the Spearman metric when evaluated on the TAC 2009 update summaries.